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Abstract 

The paper investigates efficient distributed computation in dynamic networks in which the network 
topology changes (arbitrarily) from round to round. Random walks are a fundamental primitive in a wide 
variety of network applications; the local and lightweight nature of random walks is especially useful 
for providing uniform and efficient solutions to distributed control of dynamic networks. Given their 
applicability in dynamic networks, we focus on developing fast distributed algorithms for performing 
random walks in such networks. 

Our first contribution is a rigorous framework for design and analysis of distributed random walk al- 
gorithms in dynamic networks. We then develop a fast distributed random walk based algorithm that runs 
in 0(\/t$) round^(with high probability), where r is the dynamic mixing time and $ is the dynamic 
diameter of the network respectively, and returns a sample close to a suitably defined stationary distri- 
bution of the dynamic network. We also apply our fast random walk algorithm to devise fast distributed 
algorithms for two key problems, namely, information dissemination and decentralized computation of 
spectral properties in a dynamic network. 

Our next contribution is a fast distributed algorithm for the fundamental problem of information 
dissemination (also called as gossip) in a dynamic network. In gossip, or more generally, fc-gossip, 
there are k pieces of information (or tokens) that are initially present in some nodes and the problem 
is to disseminate the k tokens to all nodes. We present a random-walk based algorithm that runs in 
0(min{?i^/^fc^/^(Ti')^/^, nfc}) rounds (with high probability). To the best of our knowledge, this is the 
first o(n/c)-time fully-distributed token forwarding algorithm that improves over the previous-best 0{nk) 
round distributed algorithm [Kuhn et al., STOC 2010], although in an oblivious adversary model. 

Our final contribution is a simple and fast distributed algorithm for estimating the dynamic mixing 
time and related spectral properties of the underlying dynamic network. 

Keywords: Dynamic Network, Distributed Algorithm, Random walks, Random sampling, Information Dis- 
semination, Gossip. 



*eBay Research Labs, eBay Inc., CA, USA. E-mail; atish . dassarmaSgmail . com 

^Division of Mathematical Sciences, Nanyang Technological University, Singapore 637371. E-mail: anisurpmSgmail . com. 
Supported in part by Nanyang Technological University grant M58110000. 

^Division of Mathematical Sciences, Nanyang Technological University, Singapore 637371 and Department of Computer Sci- 
ence, Brown University, Providence, RI 02912, USA. E-mail: gopalpandurangan@gmail.com. Supported in part by the 
following research grants: Nanyang Technological University grant M58110000, Singapore Ministry of Education (MOE) Aca- 
demic Research Fund (AcRF) Tier 2 grant MOE2010-T2-2-082, and a grant from the US-Israel Binational Science Foundation 
(BSF). 

'O hides polylog n factors where n is the number of nodes in the network. 



1 Introduction 

Random walks play a central role in computer science spanning a wide range of areas in both theory and 
practice. Random walks are used as an integral subroutine in a wide variety of network applications ranging 
from token management and load balancing to search, routing, information propagation and gathering, net- 
work topology construction and building random spanning trees (e.g., see |[T2l and the references therein). 
They are particularly useful in providing uniform and efficient solutions to distributed control of dynamic net- 
works Elm. Random walks are local and lightweight and require little index or state maintenance which 
make them especially attractive to self-organizing dynamic networks such as peer-to-peer, overlay, and ad 
hoc wireless networks. In fact, in highly dynamic networks, where the topology can change arbitrarily from 
round to round (as assumed in this paper), extensive distributed algorithmic techniques that have been devel- 
oped for the last few decades for static networks (see e.g., Il27ll22ll28l ) are not readily applicable. On the 
other hand, we would like distributed algorithms to work correctly and terminate even in networks that keep 
changing continuously over time (not assuming any eventual stabilization). Random walks being so simple 
and very local (each subsequent step in the walk depends only on the neighbors of the current node and does 
not depend on the topological changes taking place elsewhere in the network) can serve as a powerful tool 
to design distributed algorithms for such highly dynamic networks. However, it remains a challenge to show 
that one can indeed use random walks to solve non-trivial distributed computation problems efficiently in 
such networks, with provable guarantees. Our paper is a step in this direction. 

A key purpose of random walks in many of the network applications is to perform node sampling. While 
the sampling requirements in different applications vary, whenever a true sample is required from a random 
walk of certain steps, typically all applications perform the walk naively — by simply passing a token from 
one node to its neighbor: thus to perform a random walk of length i takes time linear in £. In prior work 
|[T2l[T3]| . the problem of performing random walks in time that is significantly faster, i.e., sublinear in i, was 
studied. In |[T3l . a fast distributed random walk algorithm was presented that ran in time sublinear in i, i.e., 
in 0{\flD') rounds (where D is the network diameter). This algorithm used only small sized messages (i.e., 
it assumed the standard CONGEST model of distributed computing |[27ll ). However, a main drawback of 
this result is that it applied only to static networks. A major problem left open in [.13il is whether a similar 
approach can be used to speed up random walks in dynamic networks. 

The goals of this paper are two fold: (1) giving fast distributed algorithms for performing random walk 
sampling efficiently in dynamic networks, and (2) applying random walks as a key subroutine to solve non- 
trivial distributed computation problems in dynamic networks. Towards the first goal, we first present a 
rigorous framework for studying random walks in a dynamic network (cf . Section [2]). (This is necessary, 
since it is not immediately obvious what the output of random walk sampling in a changing network means.) 
The main purpose of our random walk algorithm is to output a random sample close to the "stationary dis- 
tribution" (defined precisely in Section [2]) of the underlying dynamic network. Our random walk algorithms 
work under an oblivious adversary that fully controls the dynamic network topology, but does not know 
the random choices made by the algorithms (cf. Section|4]for a precise problem statements and results). We 
present a fast distributed random walk algorithm that runs in 0(-v/rl>) with high probability (w.h.p.) where 
T is (an upper bound on) the dynamic mixing time and <^ is the dynamic diameter of the network respectively 
(cf. Section[6]). Our algorithm uses small-sized messages only and returns a node sample that is "close" to the 
stationary distribution of the dynamic network (assuming the stationary distribution remains fixed even as the 
network changes). (The precise definitions of these terms are deferred to Section [2]). We further extend our 
algorithm to efficiently perform and return k independent random walk samples in 0(min{\/fcr¥, + r}) 
rounds (cf. Section [7]l. This is directly useful in the applications considered in this paper. 

Towards the second goal, we present two main applications of our fast random walk sampling algorithm 
(cf. Section[8]l. The first key application is a fast distributed algorithm for the fundamental problem of infor- 
mation dissemination (also called as gossip) in a dynamic network. In gossip, or more generally, A;-gossip, 

'With high probabihty means with probability at least 1 — l/n^^^\ where n is the number of nodes in the network. 
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there are k pieces of information (or tokens) that are initially present in some nodes and the problem is to 
disseminate the k tokens to all nodes. In an n-node network, solving n-gossip allows nodes to distribu- 
tively compute any computable function of their initial inputs using messages of size 0(logn + d), where 
d is the size of the input to the single node |fT9l . We present a random-walk based algorithm that runs in 



0(min{n^/^/c^/^(T<I>)^/^, n/c}) rounds with high probability (cf. Section 8.1 1. To the best of our knowledge, 
this is the first o(nA;)-time fully-distributed token forwarding algorithm that improves over the previous-best 
0{nk) round distributed algorithm |[T9ll . albeit under an oblivious adversarial model. A lower bound of 
0(nA;/ log n) under the adaptive adversarial model of ||T9l . was recently shown in |[T4l : hence one cannot do 
substantially better than the 0{nk) algorithm in general under an adaptive adversary. 

Our second application is a decentralized algorithm for computing global metrics of the underlying dy- 



namic network — dynamic mixing time and related spectral properties (cf. Section 8.2 1. Such algorithms 
can be useful building blocks in the design of topologically (self-)aware dynamic networks, i.e., networks 
that can monitor and regulate themselves in a decentralized fashion. For example, efficiently computing the 
mixing time or the spectral gap allows the network to monitor connectivity and expansion properties through 
time. 

2 Network Model and Definitions 

2.1 Dynamic Networks 

We study a general model to describe a dynamic network with a fixed set of nodes. We consider an oblivious 
adversary which can make arbitrary changes to the graph topology in every round as long as the graph is 
connected. Such a dynamic graph process (or dynamic graph, for short) is also known as an Evolving Graph 
||3l . Suppose V = {^1,^2, • • • , Vn] be the set of nodes (vertices) and Q = Gi, G2, ... be an infinite sequence 
of undirected (connected) graphs on V. We write Gt = {V, Et) where Et G 2^^^ is the dynamic edge set 
corresponding to round t E N. The adversary has complete control on the topology of the graph at each 
round, however it does not know the random choices made by the algorithm. In particular, in the context 
of random walks, we assume that it does not know the position of the random walk in any round (however, 
the adversary may know the starting position)]^ Equivalently, we can assume that the adversary chooses the 
entire sequence {Gt) of the graph process Q in advance before execution of the algorithm. This adversarial 
model has also been used in [3] in their study of random walks in dynamic networks. 

We say that the dynamic graph process Q has some property when each Gt has that property. For technical 
reasons, we will assume that each graph Gt is d-regular and non-bipartite. Later we will show that our results 
can be generalized to apply to non-regular graphs as well (albeit at the cost of a slower running time). The 
assumption on non-bipartiteness ensures that the mixing time is well defined, however this restriction can 
be removed using a standard technique: adding self-loops on each vertices (e.g., see [3]). Henceforth, we 
assume that the dynamic graph is a d-regular evolving graph unless otherwise stated (these two terms will be 
used interchangeably). Also we will assume that each Gt is non-bipartite (and connected). 

2.2 Distributed Computing Model 

We model the communication network as an n-node dynamic graph process ^ = Gi , G2 , . . .. Every node has 
limited initial knowledge. Specifically, assume that each node is associated with a distinct identity number 
(id). (The node ids are of size O(logn).) At the beginning of the computation, each node v accepts as 
input its own identity number and the identity numbers of its neighbors in Gi. The node may also accept 
some additional inputs as specified by the problem at hand (in particular, we assume that all nodes know n). 
The nodes are allowed to communicate through the edges of the graph Gt in each round t. We assume that 
the communication occurs in synchronous rounds. In particular, all the nodes wake up simultaneously at the 
beginning of round 1, and from this point on the nodes always know the number of the current round. We will 
use only small-sized messages. In particular, at the beginning of each round t, each node v is allowed to send 



Indeed, an adaptive adversary that always knows the current position of the random walk can easily choose graphs in each step, 
so that the walk never really progresses to all nodes in the network. 
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a message of size B bits (typically B is assumed to be O(polylogn)) through each edge e = {v,u) G Et 
that is adjacent to v. The message will arrive to u at the end of the current round. This is a standard model of 
distributed computation known as the CONGEST(B) model Il27ll25]| and has been attracting a lot of research 
attention during last two decades (e.g., see [27] and the references therein). For the sake of simplifying our 
analysis, we assume that B = 0(log^ n), although this is generalizablej^ 

There are several measures of efficiency of distributed algorithms, but we will focus on one of them, 
specifically, the running time, i.e. the number of rounds of distributed communication. (Note that the com- 
putation that is performed by the nodes locally is "free", i.e., it does not affect the number of rounds.) 

2.3 Random Walks in a Dynamic Grapli 

Throughout, we assume the simple random walk in an undirected graph: In each step, the walk goes from the 
current node to a random neighbor, i.e., from the current node v, the probability to move in the next step to a 
neighbor u is Pr(i;, u) = \/d{v) for {v, u) £ E and otherwise {d{v) is the degree of v). 

A simple random walk on dynamic graph Q is defined as follows: assume that at time t the walker is at 
node V £ V, and let N{v) be the set of neighbors of v in Gt, then the walker goes to one of its neighbors 
from N{v) uniformly at random. 

Suppose we have a random walk —)• fi —)•...—)• on a dynamic graph Q, where vq is the starting 
vertex. Then we get a probability distribution Pt on vt starting from the initial distribution Pq on vq. We 
say that the distribution Pr is stationary (or steady-state) for the graph process Q if Pt+i = Pt for all t > r. 
It is known that for every (undirected) static graph G, the distribution 7r(t>) = d{v)/2m is stationary. In 
particular, for a regular graph the stationary distribution is the uniform distribution. The mixing time of a 
random walk on a static graph G is the time t taken to reach "close" to the stationary distribution of the graph 
(see Definition 3.2 in Section |3] below). Similar to the static case, for a d-regular evolving graph, it is easy 



to verify that the stationary distribution is the uniform distribution. Also, for a d-regular evolving graph, the 
notion of dynamic mixing time (formally defined in Section [3]l is similar to the static case and is well defined 
due to the monotonicity property of distributions (cf. Lemma [l!9] in Section[3]l. We show (cf. Theorem 3.6 



in the next Section) that the dynamic mixing time is bounded by 0{y^ log n) rounds, where A is an upper 
bound of the second largest eigenvalue in absolute value of any graph in Q. Note that 0( log n) is also an 
upper bound on the mixing time of the graph having A as its second largest eigenvalue and hence the dynamic 
mixing time is upper bounded by the worst-case mixing time of any graph in Q, which will be (henceforth) 
denoted by r. Since the second eigenvalue of the transition matrix of any regular graph is bounded by 



1 — 1/n (cf. Corollary 3.8), this implies that r of a d-regular evolving graph is bounded by 0{n ) (cf. 



Section [3]l. In general, the dynamic mixing time can be significantly smaller than this bound, e.g., when all 
graphs in Q have A bounded from above by a constant (i.e., they are expanders — such dynamic graphs occur 
in applications e.g., EUTOl), the dynamic mixing time is O(logn). 

Another parameter affecting the efficiency of distributed computation in a dynamic graph is its dynamic 
diameter (also called flooding time, e.g., see L5ji9J). The dynamic diameter (denoted by <I>) of an n-node 
dynamic graph Q is the worst-case time (number of rounds) required to broadcast a piece of information 
from any given node to all n-nodes. The dynamic diameter can be much larger than the diameter {D) of any 
(individual) graph Gt- 

3 Mixing Time of Regular Dynamic Graph 

We have discussed the notion of random walk, probability distribution of a random walk , mixing time etc. 



on (dynamic) graph in Section 2.3 above. Here we formally define those notions. 



Definition 3.1 (Distribution vector). Let 7rx (t) define the probability distribution vector reached after t steps 
when the initial distribution starts with probability 1 at node x. Let vr denote the stationary distribution vector. 



*It turns out that the per-round congestion in any edge in our random walk algorithm is 0(log^ n) bits w.h.p. Hence assuming 
this bound for B ensures that the random walks can never be delayed due to congestion. This simplifies the correctness proof of our 



random walk algorithm (cf. Section 6.2.1 ) 
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Definition 3.2. [T^(e) (e-near mixing time for source x), r^^^ (mixing time for source x) and Tmix (mixing 
time)] Define T^(e) = mint : \ \7rxit) - 7r|| < e. Define r^^^, = r^(l/2e). Define Tmix = maxa;r^-^. (e is 
a small constant). 

We define tlie dynamic mixing time of a d-regular evolving grapli Q = Gi , G2 , . . . as tlie maximum 
time taken for a simple random walk starting from any node to reach close to the uniform distribution on 
the vertex set. Therefore the definition of dynamic mixing time is similar to the static case. Let r be the 
maximum mixing time of any (individual) graph GtinQ. (Note that r is bounded by 0{n?) — follows from 



Theorem 3.6 and Corollary 3.8 1. We show that dynamic mixing time is well defined due to Theorem 3.6 and 



monotonicity property of distribution (cf. Section 3.1 1 



Definition 3.3. [Dynamic mixing time] Define r^'(e) (e-near mixing time for source x) is T^(e) = mint : 
I ) — ''I" 1 1 < £■ Note that tTx (t) is the probability distribution on the graph Gt in the dynamic graph process 
{Gt : t > 1} when the initial distribution {7rx{l)) starts with probability 1 at node x on Gi. Define r^ix 
(mixing time for source x) = T^ (l/2e) and Tmix = max^; t^-^. The dynamic mixing time is upper bounded 
by r = maxjmixing time of all the static graph Gt : t > 1}. Notice that r > Tmix in general. 

It is known that simple random walks on regular, connected, non-bipartite static graph have mixing time 
0(|^7^), where A2 is the second largest eigenvalue in absolute value of the graph. Interestingly, it turns out 
that similar result holds for d-regular, connected, non-bipartite evolving graphs. We show that the mixing 
time of a simple random walk on a dynamic graph Q = Gi, G2, ... is 0(^^3^), where A is an upper bound 
of the second largest eigenvalue in absolute value of the graphs {Gt : t > 1}. 

Lemma 3.4. Let G be an undirected connected non-bipartite d-regular graph on n vertices and p = 
(pi, . . . ,pn) be any probability distribution on its vertices. Let Aq be the transition matrix of a simple 
random walk on G. Then, 

\\pAg II <\2-\\p II 

where Ao — max^— 2,.,.^72 1 1 — niax-[A2, — ^^n} be the second largest eigenvalue in absolute value. 

Proof. Let Xi, X2, ■ ■ ■ , Xn be an orthonormal set of eigenvectors of Aq with corresponding eigenvalues 
Ai > A2 > . • • > A^. Since Aq is symmetric stochastic matrix, Ai = 1 and Xi = ^ and all eigenvectors 
and eigenvalues are real. Clearly, 

||Mg - -|| = IIMg - -^g|| = ||(p - -)^g|| 

M M II II ^ II 

Since pis a probability distribution, we can write it asp = PiXi-l- I52X2+ ■ ■ .-\-l3nXn, where Pi, (32, ■ ■ ■ , Pn S 
M. Then (3^ = p ■ X^ = ^ ZiPi = 7^' ^^at PiX^ = (i, i, . . . , 1). Therefore, p-^ = Y.l=2 ft^i- 
Hence, 



I 1 1 

\P 



n 
i=2 
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Furthermore, 



\{p--)Ag\ 



n 

1=2 

n 

1=2 



\ 



i=2 



< max I A j 

i=2,...,n 



i=2 



\2 ■ \\P 



1 I 

n ' 



Thus, 



1 1 

n 



< A2 • \\p ■ 



1 1 

n ' 



□ 



An immediate corollary follows from the previous lemma: 

Corollary 3.5. Let Q = Gi,G2, ■ ■ ■ be a sequence of undirected connected non-bipartite d-regular graphs 
on the same vertex set V. Ifpo is the initial probability distribution on V and we perform a simple random 
walk on Q starting from po, then the probability distribution pt of the walk after t steps satisfies, 



\Pt 



n ' 



1 1 

n ' 



where A is an upper bound on the second largest eigenvalue in absolute value of the graphs {Gt ■ t > 1}. 

Theorem 3.6. For any d-regular connected non-bipartite evolving graph Q, the dynamic mixing time of a 
simple random walk on Q is bounded by 0(xr^ logn), where A is an upper bound of the second largest 
eigenvalue in absolute value of any graph in Q. 

Pro of. L et the random walk starts from a given vertex with distribution pQ = (1, 0, . . . , 0). From Corol- 
lary 3.5 and the fact that llpo ~ ~|| = 0{1) we have. 



Sofort = O(^logn) gives \\pt - ^|| < 



1 1 

n ' 



< A* 



□ 



Lemma 3.7. Let G be an undirected connected d-regular graph on n vertices. Let Aq be the transition 
matrix o/G. /f Ai > A2 > . . . > A„ are the eigenvalues of Aq, then Ai = 1 and for i > 2, Aj < 1 — ^j^, 
where D is the diameter of the graph. 

Proof. The normalized eigenvector corresponding to Ai = 1 is Xi = ^(1, 1, ... , 1). Consider any nor- 
malized real eigenvector X ± Xi with its eigenvalue A. Hence, X^ILi ^1 ~ ^ ^^'^ SILi ^« ~ 0' where 
X = {xi,X2, . . . , Xn). Let xt and Xg be the respectively largest and smallest co-ordinates of X. Clearly 
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a^t > 1/ \pn and Xg < 0. Let s = vi ^ V2 ^ ■ ■ ■ ^ Vk = t be the vertices on a shortest path from s to i in 
G. Consider X{I - Ag)X'^. Then, 

1 _ A = X(I - Ag)X'^ = ^ • J2 - ^j)' 

{iJ}e£;(G) 




[by Cauchy-Schwarz inequahty] 



dDn 

where k — 1 < D, the diameter of the graph. □ 

Corollary 3.8. (1 — ^) is an upper bound of the second largest eigenvalue A2 of the transition matrix of 
any undirected connected regular graph on n-vertices. 



Proof. This follows from the Lemma |3.7| and the fact that the diameter of any connected regular graph is 
bounded by 0(§). □ 

3.1 Monotonicity property of the distribution vector 

Let -Kx {t) define the probability distribution vector of a simple random walk reached after t steps when the 
initial distribution starts with probability 1 at node x. Let vr denote the stationary distribution vector. We 
show in the following lemma that the vector TTxii) gets closer to vr as t increases. 

Lemma 3.9. \\-Kx{t + 1) — 7r|| < ||vrx>(t) — vr||. 

Proof. We need to show that the definition of mixing times are consistent, i.e. monotonic in t, the walk length 
of the random walk. Let A be the transition matrix of a simple random walk on a d-regular evolving graph 
Q which in fact changes from round to round. The entries aij of A denotes the probability of transitioning 
from node i to node j. The monotonicity follows from the fact that for any transition matrix A of any regular 
graph and for any probability distribution vector p, 

\\{p-^)A\\<\\p--\\. 
n n 



This result follows from the above Lemma |3.4| and the fact that A2 < 1. 

Let vr be the stationary distribution of the matrix A. Then vr = (^,;^,...,^). This implies that if t is 
e-near mixing time, then | \pA'^ — t^W < e> by definition of e-near mixing time. Now consider | — "^1 1- 

This is equal to | |pj4*+-'- — ■kA\ \ since -kA = vr. However, this reduces to 1 1 {pA^ — 'k)A\ \ < \ \pA^ — t^W < e- 
It follows that (t + 1) is e-near mixing time and | IpA*"*"^ — 7r| I < I \pA^ ~ "^1 1 • ^ 

4 Problem Statements and Our Results 

We formally state the problems and our main results. 
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The Single Random Walk problem. Given a d-regular evolving graph Q = {V, Et) and a starting node 
s ^ V, our goal is to devise a fast distributed random walk algorithm such that, at the end, a destination 
node, sampled from a r-length waUc, outputs the source node's ID (equivalenty, one can require s to output 
the destination node's ID), where r is (an upper bound on) the dynamic mixing time of Q (cf. Section [3]l, 
under the assumption that Q is modified by an oblivious adversary (cf. Section |2]l. Note that this distribution 
will be "close" to the stationary distribution of Q (stationary distribution and r are both well-defined — cf. 
Section [3]l. Since we are assuming a d-regular evolving graph, our goal is to sample from (or close to) the 
uniform distribution (which is the stationary distribution) using as few rounds as possible. Note that we 
would like to sample fast via random walk — this is also very important for the applications considered in 
this paper. On the other hand, if one had to simply get a uniform random sample, it can be accompUshed by 
other means, e.g., it is easy to obtain it in 0(^>) rounds (by using flooding). 

For clarity, observe that the following naive algorithm solves the above problem in 0(r) rounds: The 
walk of length r is performed by sending a token for r steps, picking a random neighbor in each step. 
Then, the destination node v of this walk outputs the ID of s. Our goal is to perform such sampling with 
significantly less number of rounds, i.e., in time that is sublinear in r, in the CONGEST model, and using 
random walks rather than naive flooding techniques. As mentioned earlier this is needed for the applications 
discussed in this paper. Our result is as follows. 

Theorem 4.1. The algorithm SiNGLE-RANDOM-WALK (cf. Algorithm^ solves the Single Random Walk 
problem in a dynamic graph and with high probability finishes in O(vr^) rounds. 

The above algorithm assumes that nodes have knowledge of r (or at least some good estimate of it). (In 
many applications, it is easy to have a good estimate of r when there is knowledge of the structure of the 
individual graphs — e.g., each Gt is an expanders as in ||2j|26l.) Notice that in the worst case the value of r 
is G(n^), and hence this bound can be used even if nodes have no knowledge. Therefore putting r = 0(n^) 
in the above Theorem |4.1[ we see that our algorithm samples a node from the uniform distribution through 
a random walk in 0{nV <&) rounds w.h.p. Our algorithm can also be generalized to work for non-regular 



evolving graphs also (cf. Section 6.3 1. 



We also consider the following extension of the Single Random Walk problem, called the k Random 
Walks problem: We have k sources si, S2, Sfc (not necessarily distinct) and we want each of the k destina- 
tions to output an ID of its corresponding source, assuming that each source initiates an independent random 
walk of length r. (Equivalently, one can ask each source to output the ID of its corresponding destination.) 
The goal is to output all the ID's in as few rounds as possible. We show that: 

Theorem 4.2. The algorithm Many-Random-Walks (cf. Algorithm^ solves the k Random Walks prob- 
lem in a dynamic graph and with high probability finishes in O ( min(\/A;r<I>, k + t)] rounds. 



Information dissemination (or /c-gossip) problem. In fc-gossip, initially k different tokens are assigned to 
a set V of n{> k) nodes. A node may have more than one token. The goal is to disseminate all the k tokens 
to all the n nodes. We present a fast distributed randomized algorithm for A;-gossip in a dynamic network. 
Our algorithm uses Many-Random-Walks as a key subroutine; to the best of our knowledge, this is the 
first subquadratic time fully-distributed token forwarding algorithm. 

Theorem 4.3. The algorithm K-lNFORMATlON-DlSSEMlNATlON (cf Algorithm^ solves /c-gossip problem 
in a dynamic graph with high probability in 0(min{n^/^A;^/^(r<I>)^/'^, nA;}) rounds. 

Mixing time estimation. Given a dynamic network, we are interested in (approximately) computing the 
dynamic mixing time, assuming that the mixing time of the (individual) graphs do not change. We present 
an efficient distributed algorithm for estimating the mixing time. In particular, we show the following result 
where r^^^ is the dynamic mixing time with respect to a starting node x. We formally define these notions 
in Section [3] This gives an alternative algorithm to the only previously known approach by Kempe and 
McSherry ifTSl that can be used to estimate r^^^ in a static graph in O(r^j^) rounds. 
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Theorem 4.4. Given connected d-regular evolving graphs with dynamic diameter a node x can find, in 
0(ni/4^$T^(e)) rounds, a time f^,^ such that r^.^ < f^.^ < r^(e), where e = ggiaej^i^g^ - 

5 Related Work and Technical Overview 

Dynamic networks. As a step towards understanding the fundamental computational power in dynamic 
networks, recent studies (see e.g., lO [191 HSl El and the references therein) have investigated dynamic 
networks in which the network topology changes arbitrarily from round to round. In the worst-case model 
that was studied by Kuhn, Lynch, and Oshman |[T9]| . the communication links for each round are chosen 
by an online adversary, and nodes do not know who their neighbors for the current round are before they 
broadcast their messages. Unlike prior models on dynamic networks, the model of 1 19| (like ours) does not 
assume that the network eventually stops changing; therefore it requires that the algorithms work correctly 
and terminate even in networks that change continually over time. 

The work of [3] studied the cover time of random walks in an evolving graph (cf. Section [2]l in an 
oblivious adversarial model. In a regular evolving graph, they show that the cover time is always polynomial, 
while this is not true in general if the graph is not regular — the cover time can be exponential. However, they 
show that a lazy random walk (i.e., walk with self loops) has polynomial cover time on all graphs. We also 
use a similar strategy to show that our distributed random walk algorithms can work on non-regular graphs 
also, albeit at the cost of an increase in run time. While the work of [3] addressed the cover time of random 
walks on dynamic graphs, this paper is concerned with distributed algorithms for computing random walk 
samples fast with the goal towards applying it to fast distributed computation problems in dynamic networks. 

Recently, the work of lITOl . studies the flooding time of Markovian evolving dynamic graphs, a special 
class of evolving graphs. 

Distributed random walks. Our fast distributed random walk algorithms are based on previous such al- 
gorithms designed for static networks |[T2l \Vi\ . These were the first sublinear (in the length of the walk) 
time algorithms for performing random walks in graphs. The algorithm of [1311 performed a random walk 
of length ^ in 0{y/lD) rounds (with high probability) on an undirected network, where D is the diameter 
of the network. (Subsequently, the algorithm of [ 13 1 was shown to be almost time-optimal (up to polylog- 
arithmic factors) in [24J.) The general high-level idea of the above algorithm is using a few short walks in 
the beginning (executed in parallel) and then carefully concatenating these walks together later as necessary. 
A main contribution of the present work is showing that building on the approach of [ 13] yields speed up in 
random walk computations even in dynamic networks. However, there are some challenging technical issues 
to overcome in this extension given the continuous dynamic nature (cf. Section[6]l. One key technical lemma 
(called the Random walk visits Lemma) that was used to show the almost-optimal run time of 0{ViD) does 
not directly apply to dynamic networks. In the static setting, this lemma gives a bound on the number of 
times any node is visited in an ^-length walk, for any length that is not much larger than the cover time. More 
precisely, the lemma states that w.h.p. any node x is visited at most 0{d{x)\/l) times, in an ^-length walk 
from any starting node (d{x) is the degree of x). In this paper, we show that a similar bound applies to an 



^-length random walk on any d-regular evolving graph (cf. Lemma 6.4 1. A key ingredient in the above proof 
is showing that a technical result due to Lyons f23 ] can be made to work on an evolving graph. 

Other recent work involving multiple random walks in static networks, but in different settings include 
Alon et. al. Q, Elsasser et. al. m, and Cooper et al. ifTTl . 

Information spreading. The main application of our random walks algorithm is an improved algorithm 
for information spreading or gossip in dynamic networks. To the best of our knowledge, it gives the first 
subquadratic, fully distributed, token forwarding algorithm in dynamic networks, partially answering an 
open question raised in 1,14.1 . Information spreading is a fundamental primitive in networks which has been 
extensively studied (see e.g., |[T4 I and the references therein). Information spreading can be used to solve 
other problems such as broadcasting and leader election. 

This paper's focus is on token-forwarding algorithms, which do not manipulate tokens in any way other 
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than storing and forwarding them. Token-forwarding algorithms are simple, often easy to implement, and 
typically incur low overhead. ||T9i showed that under their adversarial model, /c-gossip can be solved by 
token-forwarding in 0{nk) rounds, but that any deterministic online token-forwarding algorithm needs 
Q.{n\ogk) rounds. In |[T4l . an almost matching lower bound of Q.{nk/ \ogn) is shown. The above lower 
bound indicates that one cannot obtain efficient (i.e., subquadratic) token-forwarding algorithms for gossip in 
the adversarial model of [19]. This motivates considering other weaker (and perhaps more realistic) models 
of dynamic networks. 

|[T4 | presented a polynomial-time offline centralized token-forwarding algorithm that solves the A;-gossip 
problem on an n-node dynamic network in 0(min{nA;, n^Jk log n}) rounds with high probability. This is 
the first known subquadratic time token-forwarding algorithm but it is not distributed, and furthermore, the 
centrahzed algorithm needs to know the complete evolution of the dynamic graph in advance. It was left 
open in llT4l whether one can obtain a fully-distributed and localized algorithm that also does not know 
anything about how the network evolves. In this paper, we resolve this open question in the affirmative. Our 
algorithm runs in 0(min{n^/^/c^/^(T$)^/^, n/c}) rounds with high probability. This is significantly faster 
than the 0{nk)-xo\m& algorithm of |fT9l as well as the above centralized algorithm of il4| when r and $ are 
not too large. Note that $ is bounded by 0{n) and in regular graphs r is 0{v?) (O(n^) in general graphs) 
and so in general, our bounds cannot be better than 0{nk). 

We note that an alternative approach based on network coding was due to |[T5l [T6l. which achieves an 
0{nk/ \ogn) rounds using 0(logn)-bit messages (which is not significantly better than the 0{nk) bound 
using token-forwarding), and 0{n+k) rounds with large message sizes (e.g., 0(n log n) bits). It thus follows 
that for large token and message sizes there is a factor i7(min{n, k} /\ogn) gap between token-forwarding 
and network coding. We note that in our model we allow only one token per edge per round and thus our 
bounds hold regardless of the token size. 

6 Algorithm for Single Random Walk 

6.1 Description of tlie Algorithm 

We develop an algorithm called Single-Random- WALK (cf. Algorithm [T]l for d-regular evolving graph 
{Q = iy, Et)). The algorithm performs a random walk of length r (the dynamic mixing time of ^ — cf. 
Section [23] ) in order to sample a destination from (close to) the uniform distribution on the vertex set V. 

The high-level idea of the algorithm is to perform "many" short random walks in parallel and later "stitch" 
the short walks to get the desired walk of length r. In particular, we perform the algorithm in two phases, 
as follows. For simplicity we call the messages used in Phase 1 as "coupons" and in Phase 2 as "tokens". 
In Phase 1, we perform d (degree of the graph) "short" (independent) random walks of length A (to bound 
the running time correctly, we show later that we do short walks of length approximately A, instead of A) 
from each node v, where A is a parameter whose value will be fixed in the analysis. This is done simply by 
forwarding d "coupons" having the ID of v from v (for each node v) for A steps via random walks. 

In Phase 2, starting at source s, we "stitch" (see Figure [T]) some of short walks prepared in Phase 1 
together to form a longer walk. The algorithm starts from s and randomly picks one coupon distributed from 
s in Phase 1. We now discuss how to sample one such coupon randomly and go to the destination vertex of 
that coupon. This can be done easily as follows: In the beginning of Phase 1, each node v assigns a coupon 
number for each of its d coupons. At the end of Phase 1 , the coupons originating at s (containing ID of 
s plus a coupon number) are distributed throughout the network (after Phase 1). When a coupon needs to 
be sampled, node s chooses a random coupon number (from the unused set of coupons) and informs the 
destination node (which will be the next stitching point) holding the coupon C through flooding. Let C be 
the sampled coupon and v be the destination node of C. s then sends a "token" to v (through flooding) 
and s deletes coupon C (so that C will not be sampled again next time at s, otherwise, randomness will be 
destroyed). The process then repeats. That is, the node v currently holding the token samples one of the 
coupons it distributed in Phase 1 and forwards the token to the destination of the sampled coupon, say v' . 
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Nodes v' are called "connectors" - they are the endpoints of the short walks that are stitched. A crucial 
observation is that the walk of length A used to distribute the corresponding coupons from stov and from v 
to v' are independent random walks. Therefore, we can stitch them to get a random walk of length 2A. We 
therefore can generate a random walk of length 3A, 4A, ... by repeating this process. We do this until we 
have completed more than r — A steps. Then, we complete the rest of the walk by doing the naive random 
walk algorithm. 




Figure 1: Figure illustrating the Algorithm of stitching short walks together. 



To understand the intuition behind this algorithm, let us analyze its running time. First, we claim that 



Phase 1 needs 0(A)(see Lemma 6.2 1 rounds with high probability. Recall that, in Phase 1, each node prepares 
d independent random walks of length A (approximately). We start with d = deg(t;) coupons from each 
node V at the same time, each edge in the current graph should receive two coupons in the average case. In 
other words, there is essentially no congestion (i.e., not too many coupons are sent through the same edge). 
Therefore sending out (just) d coupons from each node for A steps will take 0(A) rounds in expectation. This 
argument can be modified to show that we need 0(A) rounds with high probability in our model (see full 



proof of the Lemma 6.2 1. Now by the definition of dynami c dia meter, flooding takes $ rounds. We show that 
sample a coupon can be done in 0(^>) rounds (cf. Lemma 6.3 1 and it follows that Phase 2 needs 0(<I> • t/A) 



rounds. Therefore, the algorithm needs 0(A + <I> • r/A) which is 0(vt$) when we set A 

The reason the above algorithm for Phase 2 is incomplete is that it is possible that d coupons are not 
enough: We might forward the token to some node v many times in Phase 2 and all coupons distributed by v 
in the first phase are deleted. (In other words, v is chosen as a connector node many times, and all its coupons 
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have been exhausted.) If this happens then the stitching process cannot progress. To fix this problem, we will 
show (in the next section) an important property of the random walk which says that a random walk of length 
0(r) will visit each node v at most 0{^/Td) times (cf. Lemma 6.4 1. But this bound is not enough to get the 
desired running time, as it does not say anything about the distribution of the connector nodes. We use the 
following idea to overcome it: Instead of nodes performing walks of length A, each such walk i do a walk of 
length X + Ti where is a random number in the range [0, A — 1] . Since the random numbers are independent 
for each walk, each short walks are now of a random length in the range [A, 2A — 1]. This mo difica tion is 
needed to claim that each node will be visited as a connector only 0{^jTd/X) times (cf. Lemma 6.121. This 
implies that each node does not have to prepare too many short walks. It turns out that this aspect requires 
quite a bit more work in the dynamic setting and therefore needs new ideas and techniques. The compact 
pseudo code is given in Algorithm [T] 



Algorithm 1 Single-Random-Walk(s, r) 

Input: Starting node s, desired walk length r and parameter A. 

Output: Destination node of the walk outputs the ID of s. 



Phase 1: (Each node v performs d = deg(f ) random walks of length A+r j where ri (for each 1 <i < d) 
is chosen independently at random in the range [0, A — 1]. At the end of the process, there are d (not nec- 
essarily distinct) nodes holding a "coupon" containing the ID of v.) 

1: for each node do 

2: Generate d random integers in the range [0, A — 1], denoted by ri, r2, . . . , r^. 

3: Construct d messages containing its ID, a counter number and in addition, the i-th message contains 
the desired walk length of A + r^. We will refer to these messages created by node v as "coupons 
created by v". 

4: end for 

5: for i = 1 to 2A do 

6: This is the i-th round. Each node v does the following: Consider each coupon C held by v which is 
received in the {i — l)-th round. If the coupon C"s desired walk length is at most i, then v keeps this 
coupon {v is the desired destination). Else, v picks a neighbor u uniformly at random for each coupon 
C and forward C to u. 

7: end for 

Phase 2: (Stitch short walks by token forwarding. Stitch 6(r/A) walks, each of length in [A, 2 A — 

!]•) 

1: The source node s creates a message called "token" which contains the ID of s 

2: The algorithm will forward the token around and keep track of a set of connectors, denoted by C. 

Initially, C = {s] 
3: while Length of walk completed is at most r — 2A do 
4: Let V be the node that is currently holding the token. 

5: V sample one of the coupons distributed by v uniformly at random (by randomly chosen one counter 
number from the unused set of coupons). Let v' be the destination node of the sampled coupon, say 
C. 

6: V sends the token to v' through broadcast and delete the coupon C. 

7: C = C[j{v] 

8: end while 

9: Walk naively until r steps are completed (this is at most another 2A steps) 
10: A node holding the token outputs the ID of s 



11 



6.2 Analysis 

We first show the correctness of the algorithm and then analyze the time complexity. 
6.2.1 Correctness 

Lemma 6.1. The algorithm S INGLE-RANDOM- Walk, with high probability, outputs a node sample that is 
close to the uniform probability distribution on the vertex set V. 



Proof, (sketch) We know (from Theorem 3.6 1 that any random walk on a regular evolving graph reaches 
"close" to the uniform distribution at step r regardless of any changes of the graph in each round as long 
as it is d-regular, non-bipartite and connected. Therefore it is sufficient to show that Single-Random- 
Walk finishes with a node v which is the destination of a true random walk of length r on some appropriate 
dynamic graph from the source node s. We show this below in two steps. 

First we show that each short walk (of length approximately A) created in phase 1 is a true random walk on 
a dynamic graph sequence Gi, G2, . . . , Gs^ (A is some approximate value of A). This means that in every 
step t, each walk moves to some random neighbor from the current node on the graph Gt and each walk 



is independent of others. The proof of the Lemma 6.2 shows that w.h.p there is at most 0(log n) bits 



congestion in any edge in any round in Phase 1 . Since we consider CONGEST{log^ n) model, at each round 
0(log^ n) bits can be sent through each edge from each direction. Hence effectively there will be no delay in 
Phase 1 and all walks can extend their length from i to i + 1 in one round. Clearly each walk is independent 
of others as every node sends messages independently in parallel. This proves that each short walk (of a 
random length in the range [A, 2A — 1]) is a true random walk on the graph Gi, G2, . . . , Gj^. 
In Phase 2, we stitch short walks to get a long walk of length r. Therefore, the r-length random walk is not 
from the dynamic graph sequence Gi, G2, • • • , G,-; rather it is from the sequence: 

Gi, G2, . . . , G^, Gi, G2, . . . , G-^, . . . , (r/A times approximately). The stitching part is done on the graph 
sequence from Gj^^^, G^j^^^ ■ ■ ■ onwards. This does not affect the distribution of probability on the vertex 
set in each step, since the graph sequence from G^^^, Gj^j^^, ... is used only for communication. Also note 
that since we define r to be the maximum of any static graph Gt's mixing time, it clearly reaches close to the 
uniform distribution after r steps of walk in the graph sequence Gi, G2, • • • , G^, Gi, G2, . . . , G^, . . . , (r/A 
times approximately). 

Finally, when we stitch at a node v, we are sampling a coupon (short walk) uniformly at random among many 
coupons (and therefore, short walks starting at v) distributed by v. It is easy to see that this stitches short 
random walks independently and hence gives a true random walk of longer length. Thus it follows that the 
algorithm Single-Random-Walk returns a destination node of a r-length random walk (starting from s) 
on some evolving graph. □ 

6.2.2 Time Analysis 



We show the running time of algorithm Single-Random-Walk (cf. Theorem 4.1 1 using the following 
lemmas. 

Lemma 6.2. Phase 1 finishes in 0(A) rounds with high probability. 

Proof. In phase 1, each node v performs d walks of length A. Initially all the node starts with d coupons 
(or messages) and each coupon takes a random walk. We prove that after any given number of steps j, the 
expected number of coupons at node any v is still d. Though the edges are changes round to round, but at 
any round, every node has d-neighbors connected with it. So at each step every node can send (as well as 
receive) d messages. Now the number of messages we started at any node v is proportional to its degree and 
stationary distribution is uniform here.Therefore, in expectation the number of messages at any node remains 
same. Thus in expectation the number of messages, say X that go through an edge in any round is at most 
2 (from both end points). Using Chernoff's bound we get (Pr[X > 41ogn] < 2~^'°s" = n"''). It follows 
easily from there that the number of messages can go through any edge in any round is at most 4 log n with 



12 



high probabihty. Hence there will be at most 0(log^ n) bits w.h.p. in any edge per round . Since we consider 
CONGEST{log^ n) model, so there will be delay due to congestion. Hence, phase 1 finishes in 0(A) rounds 
with high probability. □ 

Lemma 6.3. Sample-Coupon always finishes within 0(<I>) rounds. 

Proof. The proof follows directly from the definition of dynamic diameter <1>. Since one can sample-coupon 
by at most flooding time and <I> is maximum of all flooding time of all vertex. □ 

We note that the adversary can force the random walk to visit any particular vertex several times. Then 
we need many short walks from each vertex which increases the round complexity. We show the following 
key technical lemma (Lemma 6.4 ) that bounds the number of visits to each node in a random walk of length 
I. In a d-regular dynamic graph, we show that no node is visited more than 0{^jTd/ A) times as a connector 
node of a r-length random walk. For this we need a technical result on random walks that bounds the number 
of times a node will be visited in a ^-length (where I = 0{t)) random walk. Consider a simple random walk 
on a connected d-regular evolving graphs on n vertices. Let N^{y) denote the number of visits to vertex y 
by time t, given the walk started at vertex x. Now, consider k walks, each of length £, starting from (not 
necessary distinct) nodes xi,X2, ■ ■ ■ , x^. 

Lemma 6.4. (Random Walk Visits Lemma). For any nodes xi,X2, - ■ ■ , Xk, 

k 

Pr(3ys.t. ^ N^' (y) > 32 d\/k£ + Hog n + fc) <l/n. 

i=l 

To prove the above lemma we need to go through some crucial results. We start with the bound of the 
first moment of the number of visits at each node by each walk. 

Proposition 6.5. For any node x, node y and t = 0{t), 

E[Nt^{y)]<8dVtTl (1) 

To prove the above proposition, let P denote the transition probability matrix of such a random walk and 
let vr denote the stationary distribution of the walk. 

The basic bound we use is the estimate from Lyons lemma (see Lemma 3.4 in [,23,1 ). We show below that 
the Lyons lemma also holds for a regular evolving graph. 

Lemma 6.6. Let Q denote the transition probability matrix of a d-regular evolving graph, with self-loop 
probability a > 0. Let c = min {Tr{x)Q{x, y) : x ^ y and (5(x, y) > 0} > . Note that here c = as tt 
is uniform distribution. Then for any vertex x and all k > 0, a positive integer (denoting time), 

^Q\x,x) . . r 1 1 

' 1 < mm< 



'{acx/¥TT'2a2c2fA: + l)}' 



' tt{x) I- lac\/¥Tl'2a2c2(A: + l). 
Proof. Let G = {V, E) be any d-regular graph and Q be the transition probability matrix of it. Write 

C2{x,y) := T^{x)Q^{x,y) 

and note that for (x, y) G E, we have 

C2{x, y) > Tiix) [Q{x, x)Q{x, y) + Q{x, y)Q{y, y)] > 2ac. 
We write (."^{V, vr) for the vector space equipped with the inner product defined by 

(/i,/2). :=5]/i(x)/2(x)7r(x). 
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We regard elements of MX as functions from V to M. Therefore we will call eigenvectors of the matrix Q as 
eigenfunctions. Recall that the transition matrix Q is reversible with respect to the stationary distribution tt. 
The reason for introducing the above inner product is 

Claim 6.7. Let Q be a reversible transition matrix with respect to vr. Then the inner product space {£'^{V, vr), (•. 
has an orthonormal basis of real-valued eigenfunctions {fi\Y=i corresponding to real eigenvalues {Aj}. 

Proof. Denote by (•, •) the usual inner product on MY , given by (/i, /2) := X^^gy fi{x)f2{x). For a regular 
graph, Q is symmetric. The more general version proof is given in Lemma 12.2 in ||2TI where Q need 
not be symmetric. The spectral theorem for symmetric matrices guarantees that the inner product space 
{(-"^{V, tt), (•, •)) has an orthonormal basis {^Pj}^^i such that ipj is an eigenfunction with the real eigenvalue 

Xj. It is known that ^/^T is an eigenfunction of Q corresponding to the eigenvalue 1; we set ipi = ^/^T and 

1 _ 1 

Ai = 1. If Z)^ denote the diagonal matrix with diagonal entries Dt^{x, x) = 7r(x), then Q = QD-,^ ^ . Let 

_ 1 

fj = ^ ipj, then fj is an eigenfunction of Q with eigenvalue Aj. Infact: 

_i _ 1 1 _ 1 _ 1 _ 1 

Although the eigenfunctions {fj} are not necessarily orthonormal with respect to the usual inner product, 
they are orthonormal with respect to the inner product (•, •)7r: 

1 1 

6ij = iipi,ipj) = {Difi,Difj) = ifi,fj)n, 
the first equality follows since {ifj} is orthonormal with respect to the usual inner product. □ 



Let £q{V, tt) be the orthogonal complement of the constants in (."^{V, vr). Note that 1 is an eigenfunction 
of Q and that ^o(^) invariant under Q. Now we show in the following claim that each / has at least one 
nonnegative value and at least one nonpositive value, such as / E £Q(y, vr). 

Claim 6.8. Let G be an undirected connected d-regular graph on n vertices with transition matrix Aq- Let 
Ai > A2 > • • . > A„ the eigenvalues and Xi,X2, ■ ■ ■ , Xn are the corresponding eigenvectors of Ac- 
Then for each eigenvector Xi, i = 2,3, ... ,n, (other than Xi), has at least one negative and at least one 
positive co-ordinates. 

Proof. It is known that Ai = 1 and the normalized eigenvector corresponding to Ai is Xi = ;^(1, 1, . . . , 1). 
The set of eigenvectors {Xi : i = 1, 2, . . . , n} form a orthonormal basis of the eigenspace. Then for any 
normalized eigenvector X G {Xi : i = 2,3, ... ,n}, we have X _L X^. Hence, Y17=i^i ~ ^ ^^'^ 
X]"=i Xi = 0, where X = {xi,X2, ■ ■ ■ Let xi and Xs be the respectively largest and smallest co- 

ordinates of X. Then clearly x/ > 1/ ^/n and Xg < 0. □ 



Let xo be a vertex where |/| achieves its maximum. Then clearly it follows from the Claim 6.8 



. = |/(xo)|<^ E |/(x)-/(y)|<^ C2{x,y)\fix)-fiy)\/{2ac) (2) 

where ||-||oo denote the supremum norm and the factor 1/2 arises from counting each pair {x,y) in each 
order. Take / G i^iV, vr). Notice that C2{x, y) = XlxeV ~ ^- Thus, we have from equation (pi) 
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by using Cauchy-Schwartz inequality that 



2 

x,y&V 



= ^ E fi^)Mx)Q\x,y) 

x,y&V 
x,y&V 

+ J E fiy)Mx)Q\x,y) 



x,yGV 

By reversibility, 7r{x)Q'^(x, y) = TT{y)Q^{y, x), and the first and last terms above are equal to common value 



x&V y&V x&V 

Therefore the above inequality becomes, 

(2ac)2||/||^ < Y fi^)Mx) - E /(^) [E f{y)QH^,y)Hx) 

xev xev yev 

= {f,f).-{f,Q^f). 
= ((i-Q')/,/).. 

Alternatively, we may apply (jlj) to the function sgn(/)/^. Using the trivial inequality 

|sgn(s)s2 - sgn{t)t^\ < \s - t\i\s\ + \t\), 
valid for any real numbers s and t, we obtain that 



2 



i2acnf\t< r- E C2{x,y)\f{x)-f{y)\-{\fix)\ + \fiy)\) 

\ x,y&V J 

< E C2(x,y)[/(x)-/(y)f ) • y- E C2(x,y)[|/(x)| + |/(y)|]^ 

\ x.yiiy I \ x,y&V 

= ((I-Q')/,/).-((II + Q')l/|,|/l). 

by the Cauchy-Schwartz inequality and same algebra as above. Therefore, if (/, f)n < 1, we have 2(ac)^ ||/||^ < 

((i-Q')/,/).- 

Putting both these estimates together, we get 

2(ac)2 max{2||/||^, ||/||^} < ((I - Q^)f, f)^ (3) 

for (/, /)7r < 1. Now we show that the above inequality is also holds for the regular evolving graph. 

Claim 6.9. Let Q = Gi,G2, ■ ■ ■ be a d-regular, connected evolving graph with the same set V of nodes. Let 
Aq. be the transpose of the transition matrix of Gi. Let the column vector f = {pi,P2, ■ ■ ■ ,Pn)'^ be any 
probability distribution on V. Then ||(^G,+i^Gi • • • ^gJ/IU < ||(^Gi^G,_i • • • AG^)f\\oo for alii > 1. 
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Proof. It is known that the transition matrix of any regular graph is doubly stochastic and if a matrix Q is dou- 
bly stochastic then so is Q^. Let (^G.^G,_i ••• ^d)/ = (pl,p|,...,pirand||(AG,^G,_i •••^Gi)/||oo = 
max{pj : / = 1, 2, . . . , n} = Ip^I (say). Then 

j£N(l) jeN(2) jeN(n) 

where N{v) is the set of neighbors of v and ajj is the ij -th entries of the matrix (^g^^jAg. . . . Aq^)- We 
show that the absolute value of any co-ordinates of {Ac^^-^Aci ■ ■ ■ ^d)/ is < IpW - Infact for any /, 

I Y - Y Mp\\ ^ i^^fci Y = i^fci' 

since the matrix is doubly stochastic, the last sum is 1. □ 



Now apply the inequality ^ to Q^f for I = 0,1, ... ,k. Summing these inequalities and using Claim 6.9 
to obtain, 

k k 

{k + mac)' max{2||QVllL, WQ'fWL) < ^i^cf max{2 ^Hg^foo} 

/=0 1=0 

k 
1=0 



= Y((^-Q')Q''f^f)- 

1=0 

for (/, f)^ < 1. This shows that the norm of : il{V, vr) i'^{V) is bounded by 

13k := uim{[{2acfik + 1)]-'/^ [{ac)\2k + 2)]-'/'}. 

Let T : fiV,TT) ioiV,TT) be the orthogonal projection Tf := f - (/,1)^1. Given what we have 
shown, we see that the norm of Q^T : vr) e°°{V) is bounded by /3fc. By duality, the same bound 
holds for TQ'' : i^(y,7r) — )• vr). Therefore by composition of mapping we deduce that the norm of 
Q'^TQ^ : f{V,7r) -)■ ('^{V) is at most /3| and the norm of Q^TQ^+^ : £i(y,7r) l'^{V) is at most 
PkPk+i- Applying these inequalities to / := la;/7r(x) gives the required bound. □ 



The more general case is proved in Lyons (see Lemma 3.4 and Remark 4 in II23I ). Sometimes, it is 
more convenient to use the following bound; For k = 0{t) and small a, the above can be simplified to the 
following bound; see Remark 3 in 1231 . 

QHx,y)<^^ = ^. (4) 
^ ^ - cVk + l VkTl 

Note that given a simple random walk on a graph G, and a corresponding matrix P, one can always 
switch to the lazy version Q = {I + P)/2, and interpret it as a walk on graph G' , obtained by adding self- 
loops to vertices in G so as to double the degree of each vertex. In the following, with abuse of notation we 
assume our P is such a lazy version of the original one. 
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Proof of Proposition 6.5 Remember that the evolving graph is = Gi, G2, . . .. Let Xq, Xi, . . . describe 
the random walk, with Xi denoting the position of the walk at time i > on Gj+i, and let 1a denote the 
indicator (0-1) random variable, which takes the value 1 when the event A is true. In the following we also 
use the subscript x to denote the fact that the probability or expectation is with respect to starting the walk at 
vertex x. First the expectation. 



i=0 i=0 

t 

< 



E[iV-(y)] = E,.[^l|^^=,|] = Y^P^{x,y) 

i=0 

* 1 

Ad , (using the above inequality Q) 

1=0 

< 8dVt + 1 . 

□ 

Using the above proposition, we bound the number of visits of each walk at each node, as follows. 
Lemma 6.10. For t = 0{t) and any vertex y £ G, the random walk started at x satisfies: 

Pr(iVf (y) > 32 dVt + llogn) < . 

Proof. First, it follows from the Proposition that 

Pr(iVf(y) >4•8(^^/^TT) < ^. (5) 

For any r, let L^{y) be the time that the random walk (started at x) visits y for the r*^ time. Observe that, 
for any r, Nf{y) > r if and only if L^{y) < t. Therefore, 

Vv{Nf{y)>r)=Y>v{my)<t). (6) 

Let r* = 32 dv'tTI. By Q and Pr(L^, {y)<t)<\. We claim that 

/l\'°s" 1 

Pr(L^.l„g„(y)<t)< (^-j =-^. (7) 

To see this, divide the walk into log n independent subwalks, each visiting y exactly r* times. Since the event 
L^', iog„(y) < t impUes that all subwalks have length at most t, ^ follows. Now, by applying ^ again, 

Pr(iVf (y) > r*logn) = Pr(L?;. Jy) <t)<\ 

as desired. □ 

We now extend the above lemma to bound the number of visits of all the walks at each particular node. 
Lemma 6.11. For t = 0{t), and for any vertex y £ G, the random walk started at x satisfies: 

k 

i2 



k ^ 

Pr N^' (y) > 32 dVkt + 1 log n + A;) < ^ 
i=i ^ 
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Proof. First, observe that, for any r. 



Pr(^iVf (y) >r-k)< Pr[iV^j(y) > r] 



1=1 

To see this, we construct a walk W of length kt starting at y in the following way: For each i, denote a walk 
of length t starting at xi by Wi. Let Tj and r^' be the first and last time (not later than time t) that Wi visits 
y. Let Wl be the subwalk of Wi from time Tj to r^'. We construct a walk W by stitching •••> 
together and complete the rest of the walk (to reach the length kt) by a normal random walk. It then follows 
that the number of visits to y by Wi , W2, ■ ■ ■ , (excluding the starting step) is at most the number of visits 
to y by W . The first quantity is Yl\=i ^t' iu) ~ ^- term '—k' comes from the fact that we do not count 
the first visit to y by each Wi which is the starting step of each W/.) The second quantity is N^^{y). The 
observation thus follows. 
Therefore, 

k 

Pr iVf (y) > 32 dVkt + 1 log n + k) 

< Pr (Nl^iy) > 32 dVkt + llogn) 

1 

< -2 



where the last inequality follows from Lemma 6.10 □ 



Now the Random Walk Visits Lemma (cf. Lemma 6.4 1 follows immediately from Lemma 6.1 1 by union 
bounding over all nodes. 

The above lemma says that the number of visits to each node can be bounded. However, for each node, 
we are only interested in the case where it is used as a connector (the stitching points). The lemma below 
shows that the number of visits as a connector can be bounded as well; i.e., if any node appears t times in the 
walk, then it is likely to appear roughly t/X times as connectors. 

Lemma 6.12. For any vertex v, ifv appears in the walk at most t times then it appears as a connector node 
at most t(log n)^/X times with probability at least 1 — 1/ n^. 

Proof. Intuitively, this argument is simple, since the connectors are spread out in steps of length approxi- 
mately A. However, there might be some periodicity that results in the same node being visited multiple 
times but exactly at A-intervals. To overcome this we crucially use the fact that the algorithm uses short 
walks of length A + r (instead of fixed length A) where r is chosen uniformly at random from [0, A — 1] . Then 
the proof can be shown via constructing another process equivalent to partitioning the r steps into intervals 
of A and then sampling points from each interval. The detailed proof follows immediately from the proof of 
the Lemma 2.7 in US. □ 



Now we are ready to proof the main result (Theorem 4.1 1 of this section. 
Proof of the Theorem |4jT] (restated below) 

Theorem 6.13. The algorithm Single-Random-walk (cf. Algorithm^ solves the Single Random Walk 
problem and with high probability finishes in 0{^/t^) rounds. 
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Proof. First, we claim, using Lemma |6.4| and |6.12[ that each node is used as a connector node at most 

32 d^{\ogn) 



^ times with probability at least 1 — 2/n. To see this, observe that the claim holds if each 
node X is visited at most t{x) = 32 d^J r + 1 log n times and consequently appears as a connector node 
at most t(x)(logn)^/A times. By Lemma 6.4 the first condition holds with probability at least 1 — 1/n. 



By Lemma 6. 12 and the union bound over all nodes, the second condition holds with probability at least 
1 — 1/n, provided that the first condition holds. Therefore, both conditions hold together with probability at 
least 1 — 2/n as claimed. 



Now, we choose A = 32-v/T<l>(logn)^. By Lemma 6.2 Phase 1 finishes in 0(A) = 0(\/t^) rounds with 
high probability. For Phase 2, Sample-Coupon is invoked 0( J) times (only when we stitch the walks) 



and therefore, by Lemma 6.3 contributes O(^) = 0(\/t^) rounds. 

Therefore, with probability at least 1 — 2/n, the rounds are 0(\/r$) as claimed. □ 

6.3 Generalization to non-regular evolving graphs 

By using a lazy random walk strategy, we can generalize our results to work for a non-regular dynamic graph 
also. The lazy random walk strategy "converts" a random walk on an non-regular graph to a slower random 
walk on a regular graph. 

Definition 6.14. At each step of the walk pick a vertex v from V uniformly at random and if there is an edge 
from the current vertex to the vertex v then we move to v, otherwise we stay at the current vertex. 

This strategy of lazy random walk in fact makes the graphs n-regular: every edge adjacent to the current 
vertex is picked with the probability 1/n and with the remaining probability we stay at the current vertex. 
Using this strategy, we can obtain the same results on non-regular graphs as well, but with a factor of n 
slower. In fact, we can do better, if nodes know an an upper bound dmax on the maximum degree of the 
dynamic network. Modify the lazy walk such that at each step of the walk stay at the current vertex u with 
probability 1 — {d{u) / {dmax + 1)) and with the remaining probability pick a neighbors uniformly at random. 
This only results in a slow down by a factor of dmax compared to the regular case. 

7 Algorithm for k Random Walks 

The previous section was devoted to performing a single random walk of length r (mixing time) efficiently 
to sample from the stationary distribution. In many applications, one typically requires a large number of 
random walk samples. A larger amount of samples allows for a better estimation of the problem at hand. 
In this section we focus on obtaining several random walk samples. Specifically, we consider the scenario 
when we want to compute k independent walks each of length r from different (not necessarily distinct) 
sources si, S2, • • • , Sfc. We show that Single-Random- WALK (cf. Algorithm[T]l can be extended to solve 
this problem. In particular, the algorithm Many-Random- WALKS (for pseudocode cf. Algorithm |2]) to 
compute k walks is essentially repeating the Single-Random- Walk algorithm on each source with one 
common/shared phase, and yet through overlapping computation, completes faster than k times the previ- 
ous bound. The crucial observation is that we have to do Phase 1 only once and still ensure all walks are 
independent. The high level analysis is following. 

Many-Random-Walks : Let A = (32\/A;r<I) + 1 \ogn + k){\ognf. If A > r then run the naive random 
walk algorithm. Otherwise, do the following. First, modify Phase 2 of Single-Random-Walk to create 
multiple walks, one at a time; i.e., in the second phase, we stitch the short walks together to get a walk of 
length T starting at si then do the same thing for S2, S3, and so on. We show that Many-Random-Walks 
algorithm finishes in O ^min(-v/fcT^, k + r)^ rounds with high probability. This result is also stated in the 
Theorem 4.2 (Section|4]l, but the formal proof is given below. The details of this specific extension is similar 



to the previous ideas even for the dynamic setting. 
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7.1 Proof of the Theorem 4.2 (restated below) 



Theorem 7.1. Many-Random- Walks (cf. Algorithm^ finishes in O (^min(\/fcr¥, k + r)^ rounds with 
high probability. 



^. First, consi der t he case where A > r. 
). By Lemma 



6.4 



each node x will be 
the congestion is 

kr + k + r) 



6.2 



Proof. Recall that we assume A = (32\/ kr^ + 1 log n + A;)(logn) 
In this case, mm{V kr^ + k, \fkT + A; + r) = 0{-\/krr + k -\- t 
visited at most 0{d{^/kT + k)) times. Therefore, using the same argument as Lemma 
d{VkT + k) with high probability. Since the dilation is r, Many-Random- WALKS takes 0( 
rounds as claimed. Since 2\fhT < k + t, this bound reduces to 0{k + r). 

Now, consider the other case where A < r. In this case, min(-v/A;r<I> + A;, y/kr + k + r) = 0{VkT^ + k). 
Phase 1 takes 0(A) = 0(\/A;r$ + k). The stitching in Phase 2 takes 0(A;^>r/A) = 0(\/A?t¥). Since 
k^r/X > k^ > k, the total number of rounds required is 0{VkT^) as claimed. □ 



Algorithm 2 MANY-RANDOM-WALKS({sj}, 1 < j < k, t) 

Input: Starting nodes si, S2, ■ ■ ■ , Sk, (not necessarily distinct) and desired walks length r and parameter A. 
Output: Each destination node of the walks outputs the ID of its corresponding source. 

Case 1. When A > r. [we assumed A = (32\/Arr^~+Tlog n + fc)(log n)^] 
1: Run the naive random walk algorithm, i.e., the sources find walks of length r simultaneously by sending 
tokens. 
Case 2. When A < r. 

Phase 1 : (Each node v performs d random walks of length A + where (for each 1 < i < d) is chosen 
independently at random in the range [0, A — 1]. At the end of the process, there are d (not necessarily 
distinct) nodes holding a "coupon" containing the ID of v.) 

1: for each node do 

2: Perform d walks of length A + r^, as in Phase 1 of algorithm S INGLE-RANDOM- WALK. 
3: end for 

Phase 2: (Stitch 0(t/A) short walks for each source node sj) 
I : for j = 1 to k do 

2: Consider source sj. Use algorithm Single-Random-Walk to perform a walk of length r from Sj. 
3: When algorithm Single-Random- WALK terminates, the sampled destination outputs ID of the 

source sj. 
4: end for 



8 Applications 

While the previous sections focused on performing the fundamental primitive of random walks efficiently in a 
dynamic network, in this section we show that these techniques actually directly help in specific applications 
in dynamic networks as well. 

8.1 Information Dissemination (or fc-Gossip) 

We present a fully distributed algorithm for the k-gossip problem in d-regular evolving graphs (full pseu- 
docode is given in Algorithm [3]l. Our distributed algorithm is based on the centralized algorithm of [14] 
which consists of two phases. The first phase consists of sending some / copies (the value of the parameter 
/ will be fixed in the analysis) of each of the k tokens to a set of random nodes. We use algorithm Many- 
Random-Walk (cf. algorithm[2]l to efficiently do this. In the second phase we simply broadcast each token 
t from the random places to reach all the nodes. We show that if every node having a token t broadcasts it 
for 0{n log n//) rounds, then with high probability all the nodes will receive the token t. 
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Algorithm 3 K-1nformation-Dissemination(^, k) 

Input: An evolving graphs Q : Gi,G2, ■ ■ ■ and k token in some nodes. 

Output: To disseminate k tokens to all the nodes. 

Phase 1: (Send / = n^^^{k/T^)^^'^ copies of each token to random places) 

1: Every node holding token t, send / = n^/^(fc/r<I>)^/^ copies of each token to random nodes using 
algorithm Many-Random-Walk. 
Phase 2: (Broadcast each token for 0(n log n/ f) rounds) 
1: for each token t do 

2: For the next 2n log n// rounds, let all the nodes has token t broadcast the token. 
3: end for 



We show that our proposed A:-gossip algorithm finishes in 0{n^^^k^^^{T^y/^) rounds w.h.p. To make 
sure that the algorithm terminates in 0{nk) rounds, we run the above algorithm in parallel with the trivial 
algorithm (which is just broadcast each of the k tokens sequentially; clearly this will take 0{nk) rounds in 
total) and stops when one of the two algorithm stop. Thus the claimed bound in Theorem |4 . 3 1 holds . The 
formal proof is below. 

Proof of the Theorem [43] (restated below) 

Theorem 8.1. The algorithm (cf. algorithm^ solves k-gossip problem with high probability 
in 0(min{n-^/'^/c^/'^(r<^)^/^, nfc}) rounds. 

Proof. We are running both the trivial and our proposed algorithm in parallel. Since the trivial algorithm 
finishes in 0{nk) rounds, therefore we concentrate here only on the round complexity of our proposed algo- 
rithm. 

We are sending / copies of each k token to random nodes which means we are sampling kf random nodes 
from uniform distribution. So using the Many-Random-Walk algorithm, phase 1 takes 0{^/kjT^) 
rounds. 

Now fix a node v and a token t. Let S be the set of nodes which has the token t after phase 1 . Since the 
token t is broadcast for 2n log n// rounds, there is a set 5* of atleast 2n log n// nodes from which v is reach- 
able within 2n log n// rounds. This is follows from the fact that at any round at least one uninformed node 
will be informed as the graph being always connected. It is now clear that if S intersects 5*, v will receive 
token t. The elements of the set S were sampled from the vertex set through the algorithm Many-Random- 
Walk which sample nodes from close to uniform distribution, not from actual uniform distribution. We can 
make it though very close to uniform by extending the walk length multiplied by some constant. Suppose 
Many-Random-Walk algorithm samples nodes with probability l/n^l/v? which means each node in S 
is sampled with probability l/rnt 1/n^. So the probability of a single node w £ S does not intersect 5* is at 
most (1-|S'*|(^±^)) = (1- X il^)- Therefore the probability of any of the / sampled node in S 

does not intersect 5* is at most (1 — '^i'^^^y^s^ y ^ Nqw using union bound we can say that every 

node in the network receives the token t with high probability. This shows that phase 2 uses knlogn/ f 
rounds and sends all k tokens to all the nodes with high probability. Therefore the algorithm finishes in 
0{yJkfT^ + kn/ f) rounds. Now choosing / = n2/^(/c/T$)^/^ gives the bound as 0(n^/^A;2/^(r<l))^/^). 
Hence, the /c-gossip problem solves with high probability in 0(min{n^/^/c^/^(r$)^/^, nk}) rounds. □ 



Note that the mixing time r of a regular dynamic graph is at most 0{n ) (follows from Theorem 3.6 



and 

Corollary 3.8 1. Putting this in Theorem |4.3[ yields a better bound for fe-gossip problem in a regular dynamic 
graph. 
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8.2 Decentralized Estimation of Mixing Time 

We focus on estimating the dynamic mixing time r of a d-regular connected non-bipartite evolving graph 
G = Gi, G2, ■ ■ ■■ We discussed in Section [3] that r is maximum of the mixing time of any graph in {Gt : 
t > 1}. To make it appropriate for our algorithm, we will assume that all graphs Gt in the graph process Q 
have the same mixing time Tmix- Therefore r = Tmix- While the definition of r (cf. Definition |3 .31 ) itself is 
consistent, estimating this value becomes significantly harder in the dynamic context. The intuitive approach 
of estimating distributions continuously and then adapting a distribute-closeness test works well for static 
graphs, but each of these steps becomes far more involved and expensive when the network itself changes 
and evolves continuously. Therefore we need careful analysis and new ideas in obtaining the following 
results. We introduce related notations and definitions in Section [3] 

The goal is to estimate r^-^ (mixing time for source x). Notice that the definition r^-^ and dynamic 
mixing time, r (cf . Section [3]) are consistent for a d-regular evolving graph Q = Gi , G2 , . . . due to the 



monotonicity property (cf. Lemma 3.9 1 of distributions. 

We now present an algorithm to estimate r. The main idea behind this approach is, given a source 
node, to run many random walks of some length i using the approach described in Section [7] and use these 
to estimate the distribution induced by the ^-length random walk. We then compare the the distribution at 
length i, with the stationary distribution to determine if they are close, and if not, double £ and retry. 

For the case of static graph (with diameter D), Das Sarma et al. fT3l shows that the one can approximate 
mixing time in 0(n^/^y^L'r^(e)) rounds. We show here that this bound also holds to approximate mixing 
time even for the dynamic graphs which is d-regular. We use the technique of Batu et al. H to determine if 
the distribution is e-near to uniform distribution. Their result is restated in the following theorem. 

Tlieorem 8.2 (|4|). For any e, given 0{n^^'^poly{e~^)) samples of a distribution X over [n\, and a specified 
distribution Y, there is a test that outputs PASS with high probability if \X — Y\i < ^y=]^^. cind outputs 
FAIL with high probability if\X — Y\i>6e. 

The distribution X in our context is some distribution on nodes and Y is the stationary distribution, 
i.e., Y{v) = 1/n (assume \ V\ = n in the network). We now give a very brief description of the algo- 
rithm of Batu et. al. |4| to illustrate that it can in fact be simulated on the distributed network efficiently. 
The algorithm partitions the set of nodes in to buckets based on the steady state probabilities. Each of the 
0{n^/'^poly{e^^)) samples from X now falls in one of these buckets. Further, the actual count of number of 
nodes in these buckets for distribution Y are counted. The exact count for Y for at most 0{'n}^'^poly{e^^)) 
buckets (corresponding to the samples) is compared with the number of samples from X; these are compared 
to determine if X and Y are close. Note that the total number of nodes n and e can be broadcasted to all 
nodes in 0($) rounds and each node can determine which bucket it is in in 0($) rounds.We refer the reader 
to their paper [4] for a precise description. 

Our algorithm starts with £ = 1 and runs K = 0{^/n) walks of length i from the specified source x. As 
the test of comparison with the steady state distribution outputs FAIL (for choice of e = l/12e), I is doubled. 
This process is repeated to identify the largest I such that the test outputs FAIL with high probability and the 
smallest £ such that the test outputs PASS with high probability. These give lower and upper bounds on the 
required r^^^ respectively. Our resulting theorem is presented below. 

Proof of the Theorem (restated below) 

Theorem 8.3. Given connected d-regular evolving graphs with dynamic diameter a node x can find, in 
d[n^'^^/^T^{e)) rounds, a time such that r^-^ < f^.^ < r^(e), where e = egiaeyr^iogn - 

Proof. Our goal is to check when the probability distribution (on vertex set V) of the random walk becomes 
stationary distribution which is uniform here. If a source node knows the total number of nodes in the net- 
work (which can be done through flooding in 0(<1>) rounds), we only need (5(n^/^po/y(e~^)) samples from 
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a distribution to compare it to the stationary distribution. This can be achieved by running MultipleRan- 
DOmWalk to obtain K = 0{n^^'^poly{e~^)) random walks. We choose e = l/12e. To find the approximate 
mixing time, we try out increasing values of £ that are powers of 2. Once we find the right consecutive powers 
of 2, the monotonicity property admits a binary search to determine the exact value for the specified e. 

We have shown previously that a source node can obtain K samples from K independent random walks 
of length I in 0{\/K£^) rounds. Setting K = 0{v}/'^poly{e^^)) completes the proof. □ 

Suppose our estimate of r^.^ is close to the dynamic mixing time of the network defined as r = 
vhslKx T^ix' ^^^''^ ^^^^ would allow us to estimate several related quantities. Given a dynamic mixing time 
T, we can approximate the spectral gap (1 — A) and the conductance (^') due to the known relations that 
1^ < T < and 6(1 - A) < ^' < 6(^1^) as shown in Oil. 

9 Conclusion 

We presented fast and fully decentralized algorithms for performing several random walks in distributed 
dynamic networks. Our algorithms satisfy strong round complexity guarantees and is the first work to present 
robust techniques for this fundamental graph primitive in dynamic graphs. We further extend the work to 
show how it can be used for efficient sampling and other applications such as token dissemination. Our work 
opens several interesting research directions. In the recent years, several fundamental graph operatives are 
being explored in various distributed dynamic models, and it would be interesting to explore further along 
these lines and obtain new approaches for identifying sparse cuts or graph partitioning, and similar spectral 
quantities. As a specific question, it remains open whether the random walk techniques and subsequent 
bounds presented in this paper are optimal. Finally, these algorithmic ideas may be useful building blocks in 
designing fully dynamic self-aware distributed graph systems. It would be interesting to additionally consider 
total message complexity costs for these algorithms explicitly, even though they are implicitly encapsulated 
within the local per-edge bandwidth constraints of the CONGEST model. 
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